Introduction

Nous souhaitons réalisé l’étude d’une série temporelle et de faire des prévisions sur celle-ci.

Cette série temporelle est le trafic mensuel d’une Compagnie aérienne de janvier 2011 à août 2019.

Nos prévisions portent sur les 8 mois de l’année 2019

Représentation graphique de la série.

Import des données

Import de la base, on select que la colonne des valeurs

library(readr)
data <- read_delim("Trafic-voyageurs.csv", 
    delim = ";", locale = locale(encoding = "ISO-8859-1"))
Rows: 104 Columns: 2
── Column specification ───────────────────────────────────────────────────────────────────────────────────────────────
Delimiter: ";"
chr (1): dates
dbl (1): trafic

ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.
summary(data)
    dates               trafic      
 Length:104         Min.   :220876  
 Class :character   1st Qu.:297154  
 Mode  :character   Median :355178  
                    Mean   :354651  
                    3rd Qu.:407331  
                    Max.   :505190  
data_value <- data[,2]

Affichage

Création de la série chronologique :

data_ts <- ts(data_value, start=2011, frequency=12)
plot_1_TimeSeries(data_ts)
Registered S3 method overwritten by 'data.table':
  method           from
  print.data.table     
Registered S3 method overwritten by 'htmlwidgets':
  method           from         
  print.htmlwidget tools:rstudio

Attachement du package : ‘plotly’

L'objet suivant est masqué depuis ‘package:ggplot2’:

    last_plot

L'objet suivant est masqué depuis ‘package:stats’:

    filter

L'objet suivant est masqué depuis ‘package:graphics’:

    layout

Séparation jeu de données

#revoir l affichage car ca prend pas en compte tt 2019
data_ts_train <- window(data_ts, start = c(2011, 1), end = c(2018,12))
data_ts_test <- window(data_ts, start= c(2019,1), end = c(2019,8))
data_ts_train
        Jan    Feb    Mar    Apr    May    Jun    Jul    Aug    Sep    Oct    Nov    Dec
2011 245900 238000 263227 277991 286691 303085 256800 222012 279870 262482 232680 250491
2012 253207 243067 285105 281615 295914 318227 269288 220876 292226 282423 259679 269736
2013 297836 298520 321846 315499 320499 353498 297567 248162 318171 327165 290611 277998
2014 329673 323638 376079 357470 356857 381665 329881 285621 346323 349668 312503 339102
2015 344498 344439 386410 362362 343875 401484 352111 309220 377684 382437 338143 356961
2016 361309 367323 412595 405576 384740 402523 378002 322954 403606 414451 363939 395146
2017 399926 394249 442815 427597 421828 458617 405451 349186 433709 436849 400391 403614
2018 415292 423665 478207 443548 464162 457944 440436 366272 457318 460735 413900 426097
data_ts_test
        Jan    Feb    Mar    Apr    May    Jun    Jul    Aug
2019 443700 441499 480649 463680 453372 505190 445332 370211
plot(data_ts, xlim=c(2011,2020))
lines(data_ts_test, col=3)
legend("topleft", lty = 1, col=c(1,3), legend=c("Série chronologique Train", "Série chronologique Test"))

-> strong trend -> patern qui se repete, saisonnalité ?

Représentation de la saisonnalité

Analyse de la saisonnalité en superposant chaque année (par mois):

-> en supprimant la tendance on voit bien la saisonnalité => saisonnalité régulière

ggseasonplot(data_ts)

data_ts_without_trend = diff(data_ts)
ggseasonplot(data_ts_without_trend)

Représentation des décompositions possibles

DECOMPOSITION : additive / Multiplicative Ts = Trend + Seasonal + Random / Ts = Trend * Seasonal * Random

decomposed_data <- decompose(data_ts_train, type="additive")
plot(decomposed_data$trend)

plot(decomposed_data$seasonal)

plot(decomposed_data$random)


boxplot(data_ts ~ cycle(data_ts))

-> on distingue des saisonnalités => faire régression ca n’a pas de sens => modèle de Buys Ballot

-> bonne repartition du bruit -> quelques outliers

checkresiduals(remainder(decomposed_data))
Warning in modeldf.default(object) :
  Could not find appropriate degrees of freedom for this model.

On a tendances + saisonnalité

Etude du Modèle de Buys-Ballot

Modèle

https://mpra.ub.uni-muenchen.de/77718/1/MPRA_paper_77718.pdf page 175

L’approche de BUYS-BALLOT consiste à introduire des variables indicatrices correspondant à chaque saison définit par le cycle d’observation. Pour les données trimestrielles, on intègre 4 variables indicatrices. Et pour les données mensuelles, on intègre 12 variables indicatrices.

Le modèle doit alors être estimé (sans constante) avec ces variables indicatrices.

Prédiction des valeurs de 2019

Comparaison avec les valeurs observées

Lissage moyenne mobile

Définition

Choix Moyenne mobiles

Conservation & Annulation

Lissage exponentielle

Modèles espace-état

  • meanf : Average Method : prend la valeur moyenne de toute les observations pour toutes les prédictions,
  • naive : Naive Method : prend la dernière observation pour toutes les prédictions,
  • drift : Drift Method : prend la première et la dernière observations et trace une lignes entre les deux, on utilise la courbe pour les prédictions,
  • snaive : Seasonal Naive Forecast : Prend la dernière valeur de la saison précédente comme prédiction (ex : sept 2018 = sep 2019 + erreur)
library(forecast)
mean <- meanf(data_ts_train, h=8)
naivem <- naive(data_ts_train, h=8)
driftm <- rwf(data_ts_train, h=8, drif=T)
snaivem <- snaive(data_ts_train, h=8)
plot(mean, plot.conf = F, main="")
Warning in plot.window(xlim, ylim, log, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in title(main = main, xlab = xlab, ylab = ylab, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in axis(1, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in axis(2, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in box(...) : "plot.conf" n'est pas un paramètre graphique
lines(naivem$mean, col=2, lty=1)
lines(driftm$mean, col=5, lty=1)
lines(snaivem$mean, col = 4, lty=1)
legend("topleft", lty=1, col=c(1,2,3,4), legend=c("Mean Method", "Naive Method", "Drif Method", "Seasonal Naive"))



#comparaison :
plot(snaivem, plot.conf = F, main="")
Warning in plot.window(xlim, ylim, log, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in title(main = main, xlab = xlab, ylab = ylab, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in axis(1, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in axis(2, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in box(...) : "plot.conf" n'est pas un paramètre graphique
lines(data_ts_test, col = 6, lty=1, lwd=3)


plot(driftm, plot.conf = F, main="")
Warning in plot.window(xlim, ylim, log, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in title(main = main, xlab = xlab, ylab = ylab, ...) :
  "plot.conf" n'est pas un paramètre graphique
Warning in axis(1, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in axis(2, ...) : "plot.conf" n'est pas un paramètre graphique
Warning in box(...) : "plot.conf" n'est pas un paramètre graphique
lines(data_ts_test, col = 6, lty=1, lwd=3)

On regarde : MAE : Mean Absolute Error : RMSE : Root Mean Squarred Error : MASE : Mean Absolute Scaled Error : MAPE : Mean Absolute Percentage Error :

res = pred - val MAE = sum(abs(res))/length(val) RSS = sum(res^2) MSE = RSS/length(val) RMSE = sqrt(MSE)

La plus populaire est la MAPE

MAPE(y_pred, y_true)

MAPE = (1/n) * Σ(|actual – forecast| / |actual|) * 100 “a MAPE value of 6% means that the average difference between the forecasted value and the actual value is 6%”

print(summary(mean))

Forecast method: Mean

Model Information:
$mu
[1] 346667.1

$mu.se
[1] 6731.642

$sd
[1] 65956.35

$bootstrap
[1] FALSE

$call
meanf(y = data_ts_train, h = 8)

attr(,"class")
[1] "meanf"

Error measures:
                       ME     RMSE      MAE       MPE     MAPE    MASE      ACF1
Training set 1.941958e-11 65611.93 55535.08 -3.855657 17.01186 2.16177 0.8254447

Forecasts:
checkresiduals(mean)

    Ljung-Box test

data:  Residuals from Mean
Q* = 731.64, df = 18, p-value < 2.2e-16

Model df: 1.   Total lags used: 19

accuracy(mean, data_ts_test)
                       ME      RMSE       MAE       MPE     MAPE     MASE      ACF1 Theil's U
Training set 1.941958e-11  65611.93  55535.08 -3.855657 17.01186 2.161770 0.8254447        NA
Test set     1.037870e+05 110031.92 103787.04 22.486144 22.48614 4.040036 0.0485288  2.517689
print(summary(naivem))

Forecast method: Naive method

Model Information:
Call: naive(y = data_ts_train, h = 8) 

Residual sd: 36679.9508 

Error measures:
                   ME     RMSE      MAE         MPE     MAPE     MASE       ACF1
Training set 1896.811 36679.95 29013.27 -0.02007386 8.597313 1.129377 -0.2744236

Forecasts:
checkresiduals(naivem)

    Ljung-Box test

data:  Residuals from Naive method
Q* = 248.52, df = 19, p-value < 2.2e-16

Model df: 0.   Total lags used: 19

accuracy(naivem, data_ts_test)
                    ME     RMSE      MAE         MPE     MAPE     MASE       ACF1 Theil's U
Training set  1896.811 36679.95 29013.27 -0.02007386 8.597313 1.129377 -0.2744236        NA
Test set     24357.125 43915.19 38328.62  4.72582164 8.499751 1.491988  0.0485288  1.063155
print(summary(driftm))

Forecast method: Random walk with drift

Model Information:
Call: rwf(y = data_ts_train, h = 8, drift = T) 

Drift: 1896.8105  (se 3778.1861)
Residual sd: 36825.2032 

Error measures:
                       ME     RMSE      MAE        MPE     MAPE    MASE       ACF1
Training set 2.297696e-11 36630.87 28899.04 -0.5861884 8.591266 1.12493 -0.2744236

Forecasts:
checkresiduals(driftm)

    Ljung-Box test

data:  Residuals from Random walk with drift
Q* = 248.52, df = 18, p-value < 2.2e-16

Model df: 1.   Total lags used: 19

accuracy(driftm, data_ts_test)
                       ME     RMSE      MAE        MPE     MAPE     MASE        ACF1 Theil's U
Training set 2.297696e-11 36630.87 28899.04 -0.5861884 8.591266 1.124930 -0.27442358        NA
Test set     1.582148e+04 41314.60 33586.60  2.7843152 7.582963 1.307399  0.06907259  1.007801
print(summary(snaivem))

Forecast method: Seasonal naive method

Model Information:
Call: snaive(y = data_ts_train, h = 8) 

Residual sd: 28666.7301 

Error measures:
                   ME     RMSE      MAE      MPE     MAPE MASE      ACF1
Training set 25337.46 28666.73 25689.63 7.101745 7.207375    1 0.2695124

Forecasts:
checkresiduals(snaivem)

    Ljung-Box test

data:  Residuals from Seasonal naive method
Q* = 35.426, df = 19, p-value = 0.0124

Model df: 0.   Total lags used: 19

accuracy(snaivem, data_ts_test)
                   ME     RMSE      MAE      MPE     MAPE      MASE       ACF1 Theil's U
Training set 25337.46 28666.73 25689.63 7.101745 7.207375 1.0000000  0.2695124        NA
Test set     14263.38 22148.43 16960.88 3.053421 3.648407 0.6602226 -0.5427745 0.4792835

Lissage simple

fcst_se <- ses(data_ts_train, h = 8)
print(summary(fcst_se))

Forecast method: Simple exponential smoothing

Model Information:
Simple exponential smoothing 

Call:
 ses(y = data_ts_train, h = 8) 

  Smoothing parameters:
    alpha = 0.2559 

  Initial states:
    l = 258126.0245 

  sigma:  31480.96

     AIC     AICc      BIC 
2430.727 2430.988 2438.420 

Error measures:
                   ME     RMSE      MAE      MPE     MAPE     MASE      ACF1
Training set 7057.127 31151.31 25752.89 1.326234 7.684321 1.002462 0.0711143

Forecasts:
checkresiduals(fcst_se)

    Ljung-Box test

data:  Residuals from Simple exponential smoothing
Q* = 144.66, df = 17, p-value < 2.2e-16

Model df: 2.   Total lags used: 19

plot(fcst_se)
lines(data_ts_test, col="red")



df_se = as.data.frame(fcst_se)
predict_value_se <- df_se$`Point Forecast`
MAPE(predict_value_se, data_ts_test)*100
[1] 7.658334

Optimisation du modèle

Fit Exponential Smoothing model -> trouve le meilleur lissage expo

fit_ets <- ets(data_ts_train) 
print(summary(fit_ets))
ETS(A,A,A) 

Call:
 ets(y = data_ts_train) 

  Smoothing parameters:
    alpha = 0.1568 
    beta  = 1e-04 
    gamma = 1e-04 

  Initial states:
    l = 248267.1099 
    b = 2163.3982 
    s = -17928.3 -29535.73 9295.935 11005.81 -57117.85 -7708.17
           38272.64 14592.34 16899.53 34763.15 -7344.204 -5195.15

  sigma:  11014.45

     AIC     AICc      BIC 
2241.611 2249.458 2285.205 

Training set error measures:
                    ME     RMSE      MAE        MPE     MAPE      MASE       ACF1
Training set -458.6799 10054.77 7831.554 -0.2623253 2.371375 0.3048527 0.09626331
checkresiduals(fit_ets)

    Ljung-Box test

data:  Residuals from ETS(A,A,A)
Q* = 7.1794, df = 3, p-value = 0.06639

Model df: 16.   Total lags used: 19

fcst_ets <- forecast(fit_ets, h=8)
plot(fcst_ets)
lines(data_ts_test, col="red")



df_ets = as.data.frame(fcst_ets)
predict_value_ets = df_ets$`Point Forecast`
MAPE(predict_value_ets, data_ts_test)*100
[1] 3.005848

Modèle Arima Automatique

# retourne les meilleurs paramètres 
# d=1 enleve la tendance
# D=1 enleve la saisonnalité 
# => avoir des données stationnaires
# trace : voir les résultats
fit_arima <- auto.arima(data_ts_train, d=1, D=1, stepwise = FALSE, approximation = FALSE, trace=TRUE)

 ARIMA(0,1,0)(0,1,0)[12]                    : 1846.398
 ARIMA(0,1,0)(0,1,1)[12]                    : 1833.134
 ARIMA(0,1,0)(0,1,2)[12]                    : 1835.211
 ARIMA(0,1,0)(1,1,0)[12]                    : 1833.056
 ARIMA(0,1,0)(1,1,1)[12]                    : 1835.09
 ARIMA(0,1,0)(1,1,2)[12]                    : Inf
 ARIMA(0,1,0)(2,1,0)[12]                    : 1835.207
 ARIMA(0,1,0)(2,1,1)[12]                    : 1837.012
 ARIMA(0,1,0)(2,1,2)[12]                    : 1836.461
 ARIMA(0,1,1)(0,1,0)[12]                    : 1814.951
 ARIMA(0,1,1)(0,1,1)[12]                    : 1801.155
 ARIMA(0,1,1)(0,1,2)[12]                    : 1803.362
 ARIMA(0,1,1)(1,1,0)[12]                    : 1803.592
 ARIMA(0,1,1)(1,1,1)[12]                    : 1803.361
 ARIMA(0,1,1)(1,1,2)[12]                    : Inf
 ARIMA(0,1,1)(2,1,0)[12]                    : 1805.004
 ARIMA(0,1,1)(2,1,1)[12]                    : 1805.397
 ARIMA(0,1,1)(2,1,2)[12]                    : Inf
 ARIMA(0,1,2)(0,1,0)[12]                    : 1816.915
 ARIMA(0,1,2)(0,1,1)[12]                    : 1803.033
 ARIMA(0,1,2)(0,1,2)[12]                    : 1805.296
 ARIMA(0,1,2)(1,1,0)[12]                    : 1805.702
 ARIMA(0,1,2)(1,1,1)[12]                    : 1805.295
 ARIMA(0,1,2)(1,1,2)[12]                    : Inf
 ARIMA(0,1,2)(2,1,0)[12]                    : 1807.026
 ARIMA(0,1,2)(2,1,1)[12]                    : 1807.441
 ARIMA(0,1,3)(0,1,0)[12]                    : 1817.787
 ARIMA(0,1,3)(0,1,1)[12]                    : Inf
 ARIMA(0,1,3)(0,1,2)[12]                    : Inf
 ARIMA(0,1,3)(1,1,0)[12]                    : Inf
 ARIMA(0,1,3)(1,1,1)[12]                    : Inf
 ARIMA(0,1,3)(2,1,0)[12]                    : Inf
 ARIMA(0,1,4)(0,1,0)[12]                    : 1820.052
 ARIMA(0,1,4)(0,1,1)[12]                    : Inf
 ARIMA(0,1,4)(1,1,0)[12]                    : Inf
 ARIMA(0,1,5)(0,1,0)[12]                    : Inf
 ARIMA(1,1,0)(0,1,0)[12]                    : 1825.579
 ARIMA(1,1,0)(0,1,1)[12]                    : 1812.512
 ARIMA(1,1,0)(0,1,2)[12]                    : 1814.657
 ARIMA(1,1,0)(1,1,0)[12]                    : 1813.2
 ARIMA(1,1,0)(1,1,1)[12]                    : 1814.614
 ARIMA(1,1,0)(1,1,2)[12]                    : 1816.192
 ARIMA(1,1,0)(2,1,0)[12]                    : 1815.227
 ARIMA(1,1,0)(2,1,1)[12]                    : Inf
 ARIMA(1,1,0)(2,1,2)[12]                    : 1817.796
 ARIMA(1,1,1)(0,1,0)[12]                    : 1816.841
 ARIMA(1,1,1)(0,1,1)[12]                    : 1802.853
 ARIMA(1,1,1)(0,1,2)[12]                    : 1805.117
 ARIMA(1,1,1)(1,1,0)[12]                    : 1805.653
 ARIMA(1,1,1)(1,1,1)[12]                    : Inf
 ARIMA(1,1,1)(1,1,2)[12]                    : Inf
 ARIMA(1,1,1)(2,1,0)[12]                    : Inf
 ARIMA(1,1,1)(2,1,1)[12]                    : Inf
 ARIMA(1,1,2)(0,1,0)[12]                    : 1819.234
 ARIMA(1,1,2)(0,1,1)[12]                    : 1805.22
 ARIMA(1,1,2)(0,1,2)[12]                    : 1807.539
 ARIMA(1,1,2)(1,1,0)[12]                    : 1807.381
 ARIMA(1,1,2)(1,1,1)[12]                    : 1807.538
 ARIMA(1,1,2)(2,1,0)[12]                    : 1808.925
 ARIMA(1,1,3)(0,1,0)[12]                    : 1820.05
 ARIMA(1,1,3)(0,1,1)[12]                    : 1806.055
 ARIMA(1,1,3)(1,1,0)[12]                    : 1808.732
 ARIMA(1,1,4)(0,1,0)[12]                    : Inf
 ARIMA(2,1,0)(0,1,0)[12]                    : 1824.435
 ARIMA(2,1,0)(0,1,1)[12]                    : 1811.07
 ARIMA(2,1,0)(0,1,2)[12]                    : 1813.287
 ARIMA(2,1,0)(1,1,0)[12]                    : 1811.619
 ARIMA(2,1,0)(1,1,1)[12]                    : 1813.247
 ARIMA(2,1,0)(1,1,2)[12]                    : Inf
 ARIMA(2,1,0)(2,1,0)[12]                    : 1813.821
 ARIMA(2,1,0)(2,1,1)[12]                    : 1815.872
 ARIMA(2,1,1)(0,1,0)[12]                    : Inf
 ARIMA(2,1,1)(0,1,1)[12]                    : Inf
 ARIMA(2,1,1)(0,1,2)[12]                    : Inf
 ARIMA(2,1,1)(1,1,0)[12]                    : Inf
 ARIMA(2,1,1)(1,1,1)[12]                    : Inf
 ARIMA(2,1,1)(2,1,0)[12]                    : Inf
 ARIMA(2,1,2)(0,1,0)[12]                    : Inf
 ARIMA(2,1,2)(0,1,1)[12]                    : Inf
 ARIMA(2,1,2)(1,1,0)[12]                    : Inf
 ARIMA(2,1,3)(0,1,0)[12]                    : Inf
 ARIMA(3,1,0)(0,1,0)[12]                    : 1823.646
 ARIMA(3,1,0)(0,1,1)[12]                    : 1808.49
 ARIMA(3,1,0)(0,1,2)[12]                    : 1810.542
 ARIMA(3,1,0)(1,1,0)[12]                    : 1808.594
 ARIMA(3,1,0)(1,1,1)[12]                    : 1810.321
 ARIMA(3,1,0)(2,1,0)[12]                    : 1810.708
 ARIMA(3,1,1)(0,1,0)[12]                    : Inf
 ARIMA(3,1,1)(0,1,1)[12]                    : Inf
 ARIMA(3,1,1)(1,1,0)[12]                    : Inf
 ARIMA(3,1,2)(0,1,0)[12]                    : Inf
 ARIMA(4,1,0)(0,1,0)[12]                    : 1823.996
 ARIMA(4,1,0)(0,1,1)[12]                    : 1810.199
 ARIMA(4,1,0)(1,1,0)[12]                    : 1810.845
 ARIMA(4,1,1)(0,1,0)[12]                    : Inf
 ARIMA(5,1,0)(0,1,0)[12]                    : 1825.055



 Best model: ARIMA(0,1,1)(0,1,1)[12]                    
print(summary(fit_arima))
Series: data_ts_train 
ARIMA(0,1,1)(0,1,1)[12] 

Coefficients:
          ma1     sma1
      -0.7675  -0.5465
s.e.   0.0977   0.1295

sigma^2 = 138827719:  log likelihood = -897.43
AIC=1800.85   AICc=1801.16   BIC=1808.11

Training set error measures:
                   ME     RMSE      MAE       MPE     MAPE      MASE       ACF1
Training set 805.2378 10822.93 7747.841 0.2158443 2.213481 0.3015941 0.03453594
checkresiduals(fit_arima)

    Ljung-Box test

data:  Residuals from ARIMA(0,1,1)(0,1,1)[12]
Q* = 10.898, df = 17, p-value = 0.8618

Model df: 2.   Total lags used: 19

fcst_arima <- forecast(fit_arima, h=8)
plot(fcst_arima)
lines(data_ts_test, col='red')



df_arima = as.data.frame(fcst_arima)
predict_value_arima = df_arima$`Point Forecast`
MAPE(predict_value_arima, data_ts_test)*100
[1] 2.814135
LS0tDQp0aXRsZTogfA0KICANCmF1dGhvcjogDQotIENsb3ZpcyBEZWxldHJlDQotIENoYXJsZXMgVml0cnkNCmRhdGU6DQpvdXRwdXQ6DQogIGh0bWxfbm90ZWJvb2sNCi0tLQ0KPHN0eWxlIHR5cGU9InRleHQvY3NzIj4NCg0KYm9keXsgLyogTm9ybWFsICAqLw0KICAgICAgZm9udC1zaXplOiAyMHB4Ow0KICB9DQp0ZCB7ICAvKiBUYWJsZSAgKi8NCiAgZm9udC1zaXplOiA4cHg7DQp9DQpoMS50aXRsZSB7DQogIGZvbnQtc2l6ZTogNTVweDsNCiAgY29sb3I6IERhcmtCbHVlOw0KfQ0KaDEgeyAvKiBIZWFkZXIgMSAqLw0KICBmb250LXNpemU6IDM4cHg7DQogIGNvbG9yOiBEYXJrQmx1ZTsNCn0NCmgyIHsgLyogSGVhZGVyIDIgKi8NCiAgICBmb250LXNpemU6IDI4cHg7DQogIGNvbG9yOiBEYXJrQmx1ZTsNCn0NCmgzIHsgLyogSGVhZGVyIDMgKi8NCiAgZm9udC1zaXplOiAzNXB4Ow0KICBmb250LWZhbWlseTogIlRpbWVzIE5ldyBSb21hbiIsIFRpbWVzLCBzZXJpZjsNCiAgY29sb3I6IERhcmtCbHVlOw0KfQ0KY29kZS5yeyAvKiBDb2RlIGJsb2NrICovDQogICAgZm9udC1zaXplOiAxMnB4Ow0KfQ0KcHJlIHsgLyogQ29kZSBibG9jayAtIGRldGVybWluZXMgY29kZSBzcGFjaW5nIGJldHdlZW4gbGluZXMgKi8NCiAgICBmb250LXNpemU6IDE0cHg7DQp9DQo8L3N0eWxlPg0KDQpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0NCmtuaXRyOjpvcHRzX2NodW5rJHNldChlY2hvID0gVFJVRSkNCg0Kc291cmNlKCJGb25jdGlvbnMuUiIsIGxvY2FsID0ga25pdHI6OmtuaXRfZ2xvYmFsKCkpDQoNCiNpbnN0YWxsIGZvciBleHBvcnQgaW4gcGRmIGZpbGUNCiN0aW55dGV4OjppbnN0YWxsX3Rpbnl0ZXgoKQ0KYGBgDQo8YnI+IDwvYnI+DQoNCmBgYHtyIGluY2x1ZGU9RkFMU0V9DQppZighcmVxdWlyZShmb3JlY2FzdCkpIGluc3RhbGwucGFja2FnZXMoInRtIiwgcmVwb3MgPSAiaHR0cDovL2NyYW4udXMuci1wcm9qZWN0Lm9yZyIpDQpyZXF1aXJlKGZvcmVjYXN0KQ0KDQppZighcmVxdWlyZShmcHAyKSkgaW5zdGFsbC5wYWNrYWdlcygidG0iLCByZXBvcyA9ICJodHRwOi8vY3Jhbi51cy5yLXByb2plY3Qub3JnIikNCnJlcXVpcmUoZnBwMikNCg0KaWYoIXJlcXVpcmUoTUxtZXRyaWNzKSkgaW5zdGFsbC5wYWNrYWdlcygidG0iLCByZXBvcyA9ICJodHRwOi8vY3Jhbi51cy5yLXByb2plY3Qub3JnIikNCnJlcXVpcmUoTUxtZXRyaWNzKQ0KDQoNCmxpYnJhcnkoZ2dwbG90MikNCmxpYnJhcnkoZnBwMikNCmxpYnJhcnkoTUxtZXRyaWNzKQ0KDQpgYGANCg0KIyBJbnRyb2R1Y3Rpb24NCg0KTm91cyBzb3VoYWl0b25zIHLDqWFsaXPDqSBs4oCZw6l0dWRlIGQndW5lIHPDqXJpZSB0ZW1wb3JlbGxlIGV0IGRlIGZhaXJlIGRlcyBwcsOpdmlzaW9ucyBzdXIgY2VsbGUtY2kuDQoNCkNldHRlIHPDqXJpZSB0ZW1wb3JlbGxlIGVzdCBsZSB0cmFmaWMgbWVuc3VlbCBk4oCZdW5lIENvbXBhZ25pZSBhw6lyaWVubmUgZGUgamFudmllciAyMDExIMOgIGFvw7t0IDIwMTkuDQoNCk5vcyBwcsOpdmlzaW9ucyBwb3J0ZW50IHN1ciBsZXMgOCBtb2lzIGRlIGzigJlhbm7DqWUgMjAxOQ0KDQojIFJlcHLDqXNlbnRhdGlvbiBncmFwaGlxdWUgZGUgbGEgc8OpcmllLg0KDQojIyBJbXBvcnQgZGVzIGRvbm7DqWVzDQoNCkltcG9ydCBkZSBsYSBiYXNlLCBvbiBzZWxlY3QgcXVlIGxhIGNvbG9ubmUgZGVzIHZhbGV1cnMNCmBgYHtyfQ0KbGlicmFyeShyZWFkcikNCmRhdGEgPC0gcmVhZF9kZWxpbSgiVHJhZmljLXZveWFnZXVycy5jc3YiLCANCiAgICBkZWxpbSA9ICI7IiwgbG9jYWxlID0gbG9jYWxlKGVuY29kaW5nID0gIklTTy04ODU5LTEiKSkNCmBgYA0KYGBge3J9DQpzdW1tYXJ5KGRhdGEpDQpgYGANCg0KYGBge3J9DQpkYXRhX3ZhbHVlIDwtIGRhdGFbLDJdDQpgYGANCg0KIyMgQWZmaWNoYWdlDQoNCg0KQ3LDqWF0aW9uIGRlIGxhIHPDqXJpZSBjaHJvbm9sb2dpcXVlIDogDQpgYGB7cn0NCmRhdGFfdHMgPC0gdHMoZGF0YV92YWx1ZSwgc3RhcnQ9MjAxMSwgZnJlcXVlbmN5PTEyKQ0KcGxvdF8xX1RpbWVTZXJpZXMoZGF0YV90cykNCmBgYA0KDQoNCiMjIFPDqXBhcmF0aW9uIGpldSBkZSBkb25uw6llcw0KDQoNCmBgYHtyfQ0KI3Jldm9pciBsIGFmZmljaGFnZSBjYXIgY2EgcHJlbmQgcGFzIGVuIGNvbXB0ZSB0dCAyMDE5DQpkYXRhX3RzX3RyYWluIDwtIHdpbmRvdyhkYXRhX3RzLCBzdGFydCA9IGMoMjAxMSwgMSksIGVuZCA9IGMoMjAxOCwxMikpDQpkYXRhX3RzX3Rlc3QgPC0gd2luZG93KGRhdGFfdHMsIHN0YXJ0PSBjKDIwMTksMSksIGVuZCA9IGMoMjAxOSw4KSkNCmRhdGFfdHNfdHJhaW4NCmRhdGFfdHNfdGVzdA0KDQpwbG90KGRhdGFfdHMsIHhsaW09YygyMDExLDIwMjApKQ0KbGluZXMoZGF0YV90c190ZXN0LCBjb2w9MykNCmxlZ2VuZCgidG9wbGVmdCIsIGx0eSA9IDEsIGNvbD1jKDEsMyksIGxlZ2VuZD1jKCJTw6lyaWUgY2hyb25vbG9naXF1ZSBUcmFpbiIsICJTw6lyaWUgY2hyb25vbG9naXF1ZSBUZXN0IikpDQpgYGANCi0+IHN0cm9uZyB0cmVuZA0KLT4gcGF0ZXJuIHF1aSBzZSByZXBldGUsIHNhaXNvbm5hbGl0w6kgPyANCg0KIyMgUmVwcsOpc2VudGF0aW9uIGRlIGxhIHNhaXNvbm5hbGl0w6kNCg0KQW5hbHlzZSBkZSBsYSBzYWlzb25uYWxpdMOpIGVuIHN1cGVycG9zYW50IGNoYXF1ZSBhbm7DqWUgKHBhciBtb2lzKToNCg0KLT4gZW4gc3VwcHJpbWFudCBsYSB0ZW5kYW5jZSBvbiB2b2l0IGJpZW4gbGEgc2Fpc29ubmFsaXTDqSA9PiBzYWlzb25uYWxpdMOpIHLDqWd1bGnDqHJlDQoNCmBgYHtyfQ0KZ2dzZWFzb25wbG90KGRhdGFfdHMpDQpkYXRhX3RzX3dpdGhvdXRfdHJlbmQgPSBkaWZmKGRhdGFfdHMpDQpnZ3NlYXNvbnBsb3QoZGF0YV90c193aXRob3V0X3RyZW5kKQ0KYGBgDQoNCiMjIFJlcHLDqXNlbnRhdGlvbiBkZXMgZMOpY29tcG9zaXRpb25zIHBvc3NpYmxlcw0KDQpERUNPTVBPU0lUSU9OIDogDQphZGRpdGl2ZSAvIE11bHRpcGxpY2F0aXZlIA0KVHMgPSBUcmVuZCArIFNlYXNvbmFsICsgUmFuZG9tIC8NClRzID0gVHJlbmQgKiBTZWFzb25hbCAqIFJhbmRvbQ0KDQoNCmBgYHtyfQ0KZGVjb21wb3NlZF9kYXRhIDwtIGRlY29tcG9zZShkYXRhX3RzX3RyYWluLCB0eXBlPSJhZGRpdGl2ZSIpDQpwbG90KGRlY29tcG9zZWRfZGF0YSR0cmVuZCkNCnBsb3QoZGVjb21wb3NlZF9kYXRhJHNlYXNvbmFsKQ0KcGxvdChkZWNvbXBvc2VkX2RhdGEkcmFuZG9tKQ0KDQpib3hwbG90KGRhdGFfdHMgfiBjeWNsZShkYXRhX3RzKSkNCmBgYA0KDQotPiBvbiBkaXN0aW5ndWUgZGVzIHNhaXNvbm5hbGl0w6lzID0+IGZhaXJlIHLDqWdyZXNzaW9uIGNhIG4nYSBwYXMgZGUgc2VucyANCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA9PiBtb2TDqGxlIGRlIEJ1eXMgQmFsbG90IA0KDQotPiBib25uZSByZXBhcnRpdGlvbiBkdSBicnVpdA0KLT4gcXVlbHF1ZXMgb3V0bGllcnMNCg0KYGBge3J9DQpjaGVja3Jlc2lkdWFscyhyZW1haW5kZXIoZGVjb21wb3NlZF9kYXRhKSkNCmBgYA0KDQoNCk9uIGEgdGVuZGFuY2VzICsgc2Fpc29ubmFsaXTDqSANCg0KIyBFdHVkZSBkdSBNb2TDqGxlIGRlIEJ1eXMtQmFsbG90IA0KDQojIyBNb2TDqGxlIA0KDQpodHRwczovL21wcmEudWIudW5pLW11ZW5jaGVuLmRlLzc3NzE4LzEvTVBSQV9wYXBlcl83NzcxOC5wZGYgcGFnZSAxNzUNCg0KDQpM4oCZYXBwcm9jaGUgZGUgQlVZUy1CQUxMT1QgY29uc2lzdGUgw6AgaW50cm9kdWlyZSBkZXMgdmFyaWFibGVzIGluZGljYXRyaWNlcw0KY29ycmVzcG9uZGFudCDDoCBjaGFxdWUgc2Fpc29uIGTDqWZpbml0IHBhciBsZSBjeWNsZSBkJ29ic2VydmF0aW9uLiBQb3VyIGxlcyBkb25uw6llcw0KdHJpbWVzdHJpZWxsZXMsIG9uIGludMOoZ3JlIDQgdmFyaWFibGVzIGluZGljYXRyaWNlcy4gRXQgcG91ciBsZXMgZG9ubsOpZXMgbWVuc3VlbGxlcywgb24NCmludMOoZ3JlIDEyIHZhcmlhYmxlcyBpbmRpY2F0cmljZXMuDQoNCkxlIG1vZMOobGUgZG9pdCBhbG9ycyDDqnRyZSBlc3RpbcOpIChzYW5zIGNvbnN0YW50ZSkgYXZlYyBjZXMgdmFyaWFibGVzIGluZGljYXRyaWNlcy4NCg0KIyMgUHLDqWRpY3Rpb24gZGVzIHZhbGV1cnMgZGUgMjAxOQ0KDQojIyBDb21wYXJhaXNvbiBhdmVjIGxlcyB2YWxldXJzIG9ic2VydsOpZXMNCg0KDQojIExpc3NhZ2UgbW95ZW5uZSBtb2JpbGUNCg0KIyMgRMOpZmluaXRpb24NCg0KIyMgQ2hvaXggTW95ZW5uZSBtb2JpbGVzDQoNCg0KIyMgQ29uc2VydmF0aW9uICYgQW5udWxhdGlvbiANCg0KIyBMaXNzYWdlIGV4cG9uZW50aWVsbGUNCg0KIyMgTW9kw6hsZXMgZXNwYWNlLcOpdGF0IA0KDQotIG1lYW5mIDogQXZlcmFnZSBNZXRob2QgOiBwcmVuZCBsYSB2YWxldXIgbW95ZW5uZSBkZSB0b3V0ZSBsZXMgb2JzZXJ2YXRpb25zIHBvdXIgdG91dGVzIGxlcyBwcsOpZGljdGlvbnMsIA0KLSBuYWl2ZSA6IE5haXZlIE1ldGhvZCA6IHByZW5kIGxhIGRlcm5pw6hyZSBvYnNlcnZhdGlvbiBwb3VyIHRvdXRlcyBsZXMgcHLDqWRpY3Rpb25zLA0KLSBkcmlmdCA6IERyaWZ0IE1ldGhvZCA6IHByZW5kIGxhIHByZW1pw6hyZSBldCBsYSBkZXJuacOocmUgb2JzZXJ2YXRpb25zIGV0IHRyYWNlIHVuZSBsaWduZXMgZW50cmUgbGVzIGRldXgsIG9uIHV0aWxpc2UgbGEgY291cmJlIHBvdXIgbGVzIHByw6lkaWN0aW9ucywNCi0gc25haXZlIDogU2Vhc29uYWwgTmFpdmUgRm9yZWNhc3QgOiBQcmVuZCBsYSBkZXJuacOocmUgdmFsZXVyIGRlIGxhIHNhaXNvbiBwcsOpY8OpZGVudGUgY29tbWUgcHLDqWRpY3Rpb24gKGV4IDogc2VwdCAyMDE4ID0gc2VwIDIwMTkgKyBlcnJldXIpDQpgYGB7cn0NCmxpYnJhcnkoZm9yZWNhc3QpDQptZWFuIDwtIG1lYW5mKGRhdGFfdHNfdHJhaW4sIGg9OCkNCm5haXZlbSA8LSBuYWl2ZShkYXRhX3RzX3RyYWluLCBoPTgpDQpkcmlmdG0gPC0gcndmKGRhdGFfdHNfdHJhaW4sIGg9OCwgZHJpZj1UKQ0Kc25haXZlbSA8LSBzbmFpdmUoZGF0YV90c190cmFpbiwgaD04KQ0KYGBgDQoNCmBgYHtyfQ0KcGxvdChtZWFuLCBwbG90LmNvbmYgPSBGLCBtYWluPSIiKQ0KbGluZXMobmFpdmVtJG1lYW4sIGNvbD0yLCBsdHk9MSkNCmxpbmVzKGRyaWZ0bSRtZWFuLCBjb2w9NSwgbHR5PTEpDQpsaW5lcyhzbmFpdmVtJG1lYW4sIGNvbCA9IDQsIGx0eT0xKQ0KbGVnZW5kKCJ0b3BsZWZ0IiwgbHR5PTEsIGNvbD1jKDEsMiwzLDQpLCBsZWdlbmQ9YygiTWVhbiBNZXRob2QiLCAiTmFpdmUgTWV0aG9kIiwgIkRyaWYgTWV0aG9kIiwgIlNlYXNvbmFsIE5haXZlIikpDQoNCg0KI2NvbXBhcmFpc29uIDoNCnBsb3Qoc25haXZlbSwgcGxvdC5jb25mID0gRiwgbWFpbj0iIikNCmxpbmVzKGRhdGFfdHNfdGVzdCwgY29sID0gNiwgbHR5PTEsIGx3ZD0zKQ0KDQpwbG90KGRyaWZ0bSwgcGxvdC5jb25mID0gRiwgbWFpbj0iIikNCmxpbmVzKGRhdGFfdHNfdGVzdCwgY29sID0gNiwgbHR5PTEsIGx3ZD0zKQ0KDQpgYGANCg0KDQpPbiByZWdhcmRlIDoNCk1BRSA6IE1lYW4gQWJzb2x1dGUgRXJyb3IgOiANClJNU0UgOiBSb290IE1lYW4gU3F1YXJyZWQgRXJyb3IgOg0KTUFTRSA6IE1lYW4gQWJzb2x1dGUgU2NhbGVkIEVycm9yIDoNCk1BUEUgOiBNZWFuIEFic29sdXRlIFBlcmNlbnRhZ2UgRXJyb3IgOg0KDQoNCnJlcyA9IHByZWQgLSB2YWwNCk1BRSA9IHN1bShhYnMocmVzKSkvbGVuZ3RoKHZhbCkNClJTUyA9IHN1bShyZXNeMikNCk1TRSA9IFJTUy9sZW5ndGgodmFsKQ0KUk1TRSA9IHNxcnQoTVNFKQ0KICAgIA0KDQpMYSBwbHVzIHBvcHVsYWlyZSBlc3QgbGEgTUFQRSANCg0KTUFQRSh5X3ByZWQsIHlfdHJ1ZSkNCg0KTUFQRSA9ICgxL24pICogzqMofGFjdHVhbCDigJMgZm9yZWNhc3R8IC8gfGFjdHVhbHwpICogMTAwDQoiYSBNQVBFIHZhbHVlIG9mIDYlIG1lYW5zIHRoYXQgdGhlIGF2ZXJhZ2UgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZSBmb3JlY2FzdGVkIHZhbHVlIGFuZCB0aGUgYWN0dWFsIHZhbHVlIGlzIDYlIiANCg0KYGBge3J9DQpwcmludChzdW1tYXJ5KG1lYW4pKQ0KY2hlY2tyZXNpZHVhbHMobWVhbikNCmFjY3VyYWN5KG1lYW4sIGRhdGFfdHNfdGVzdCkNCg0KYGBgDQoNCmBgYHtyfQ0KcHJpbnQoc3VtbWFyeShuYWl2ZW0pKQ0KY2hlY2tyZXNpZHVhbHMobmFpdmVtKQ0KYWNjdXJhY3kobmFpdmVtLCBkYXRhX3RzX3Rlc3QpDQoNCmBgYA0KDQpgYGB7cn0NCnByaW50KHN1bW1hcnkoZHJpZnRtKSkNCmNoZWNrcmVzaWR1YWxzKGRyaWZ0bSkNCmFjY3VyYWN5KGRyaWZ0bSwgZGF0YV90c190ZXN0KQ0KDQpgYGANCg0KYGBge3J9DQpwcmludChzdW1tYXJ5KHNuYWl2ZW0pKQ0KY2hlY2tyZXNpZHVhbHMoc25haXZlbSkNCmFjY3VyYWN5KHNuYWl2ZW0sIGRhdGFfdHNfdGVzdCkNCg0KYGBgDQoNCg0KDQoNCiMjIExpc3NhZ2Ugc2ltcGxlDQoNCmBgYHtyfQ0KZmNzdF9zZSA8LSBzZXMoZGF0YV90c190cmFpbiwgaCA9IDgpDQpwcmludChzdW1tYXJ5KGZjc3Rfc2UpKQ0KY2hlY2tyZXNpZHVhbHMoZmNzdF9zZSkNCmBgYA0KDQpgYGB7cn0NCnBsb3QoZmNzdF9zZSkNCmxpbmVzKGRhdGFfdHNfdGVzdCwgY29sPSJyZWQiKQ0KDQoNCmRmX3NlID0gYXMuZGF0YS5mcmFtZShmY3N0X3NlKQ0KcHJlZGljdF92YWx1ZV9zZSA8LSBkZl9zZSRgUG9pbnQgRm9yZWNhc3RgDQpNQVBFKHByZWRpY3RfdmFsdWVfc2UsIGRhdGFfdHNfdGVzdCkqMTAwDQpgYGANCg0KDQojIyBPcHRpbWlzYXRpb24gZHUgbW9kw6hsZQ0KDQpGaXQgRXhwb25lbnRpYWwgU21vb3RoaW5nIG1vZGVsIC0+IHRyb3V2ZSBsZSBtZWlsbGV1ciBsaXNzYWdlIGV4cG8NCmBgYHtyfQ0KZml0X2V0cyA8LSBldHMoZGF0YV90c190cmFpbikgDQpwcmludChzdW1tYXJ5KGZpdF9ldHMpKQ0KY2hlY2tyZXNpZHVhbHMoZml0X2V0cykNCg0KDQpgYGANCg0KYGBge3J9DQpmY3N0X2V0cyA8LSBmb3JlY2FzdChmaXRfZXRzLCBoPTgpDQpwbG90KGZjc3RfZXRzKQ0KbGluZXMoZGF0YV90c190ZXN0LCBjb2w9InJlZCIpDQoNCg0KZGZfZXRzID0gYXMuZGF0YS5mcmFtZShmY3N0X2V0cykNCnByZWRpY3RfdmFsdWVfZXRzID0gZGZfZXRzJGBQb2ludCBGb3JlY2FzdGANCk1BUEUocHJlZGljdF92YWx1ZV9ldHMsIGRhdGFfdHNfdGVzdCkqMTAwDQoNCmBgYA0KDQojIyBNb2TDqGxlIEFyaW1hIEF1dG9tYXRpcXVlDQoNCmBgYHtyfQ0KIyByZXRvdXJuZSBsZXMgbWVpbGxldXJzIHBhcmFtw6h0cmVzIA0KIyBkPTEgZW5sZXZlIGxhIHRlbmRhbmNlDQojIEQ9MSBlbmxldmUgbGEgc2Fpc29ubmFsaXTDqSANCiMgPT4gYXZvaXIgZGVzIGRvbm7DqWVzIHN0YXRpb25uYWlyZXMNCiMgdHJhY2UgOiB2b2lyIGxlcyByw6lzdWx0YXRzDQpmaXRfYXJpbWEgPC0gYXV0by5hcmltYShkYXRhX3RzX3RyYWluLCBkPTEsIEQ9MSwgc3RlcHdpc2UgPSBGQUxTRSwgYXBwcm94aW1hdGlvbiA9IEZBTFNFLCB0cmFjZT1UUlVFKQ0KcHJpbnQoc3VtbWFyeShmaXRfYXJpbWEpKQ0KY2hlY2tyZXNpZHVhbHMoZml0X2FyaW1hKQ0KYGBgDQoNCmBgYHtyfQ0KZmNzdF9hcmltYSA8LSBmb3JlY2FzdChmaXRfYXJpbWEsIGg9OCkNCnBsb3QoZmNzdF9hcmltYSkNCmxpbmVzKGRhdGFfdHNfdGVzdCwgY29sPSdyZWQnKQ0KDQoNCmRmX2FyaW1hID0gYXMuZGF0YS5mcmFtZShmY3N0X2FyaW1hKQ0KcHJlZGljdF92YWx1ZV9hcmltYSA9IGRmX2FyaW1hJGBQb2ludCBGb3JlY2FzdGANCk1BUEUocHJlZGljdF92YWx1ZV9hcmltYSwgZGF0YV90c190ZXN0KSoxMDANCmBgYA0KDQpgYGB7cn0NCg0KYGBgDQoNCmBgYHtyfQ0KDQoNCmBgYA0KDQoNCg0KDQoNCg==